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Work  is  currently  in  progress  to  develop  computer- 
assisted  instructional  materials  to  teach  new  vocabulary  words 
to  college  students.  Seven  different  instructional  strategies 
are  being  developed  to  teach  Che  new  words,  each  strategy 


targeted  toward  a different  learning  outcome.^  Paralleling 


' / 


the  development  objective  is  a research  objective  to  assess 
the  effectiveness  of  each  strategy  and  to  determine  which 
strategies  best  promote  transfer. 

Current  design  theories  state  that  different  instructional 
conditions  are  needed  for  different  types  of  learned  per- 
formances.  In  contrast,  a 1966  research  study  that  taught 
vocabulary  concepts  to  college  students  through  four  methods 


showed  that  students  learning  by  one  method  also  did  quite 
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well  on  tests  matched  to  the  other  methods.  We‘-hope  to 


demonstrate^through  bur  own  research  and  development  effort 
that  the  all-strategies  prescription  of  design  theory  is 
excessive  and  that  it  is  possible  to  achieve  acceptable  levels 
of  performance  on  all  seven  criterion  tests  using  fewer  than 
the  complete  set  of  strategies  available.  ' 

The  remainder  of  the  paper  discussfes  the  general  rationale 
and  design  of  the  seven  instructional  strategies  and  then 
elaborate^  upon  the  design  of  three  strategies,  DEFINE,  WORD 
RELATIONS,  and  CLASSIFY,  by  illustrating  the  teaching 
sequences  using  a sample  word  from  the  instructional  database. 

) 


- io 


I I 


security  classification  of  This  PACEriFhen  Dmlrn  En(«r«0 


Using  CAI  to  Teach  Vocabulary  Concepts'* 


Karen  K.  Block  and  Ellen  S.  McCaslln 


Learning  Research  and  Development  Center 
University  of  Pittsburgh 


, V 

I i 


I 

! 

! 


^Thls  paper  was  a part  of  the  Innovations  in  Computer-Assisted 
Instruction  for  Reading  Symposium  presented  at  the  International 
Reading  Association  Annual  Meeting,  Houston,  May  1978. 

2 

This  research  Is  sponsored  by  the  Defense  Advanced  Research 
Projects  Agency  under  ARPA  Order  No.  3395;  Contract  No. 
MDA903-77-C-0208.  The  views  and  conclusions  contained  In  this 
document  are  those  of  the  authors  and  should  not  be  Interpreted  as 
necessarily  representing  the  official  policies,  either  expressed  or 
Implied,  of  the  Defense  Advanced  Research  Agency  or  the  U.S. 
Government . 

78  06 


# 


Using  CAT  to  Teach  Vocabulary  Concepts 


Karen  K.  Block  and  Ellen  S.  McCaslln 

Learning  Research  and  Development  Center 
University  of  Pittsburgh 


Overview 

The  work  that  Is  described  In  this  paper  Is  currently  In 
progress  at  the  Learning  Research  and  Development  Center  at  the 
University  of  Pittsburgh.  The  objective  of  our  project  Is  the 
development  of  computer-assisted  Instructional  materials  to  teach 
new  vocabulary  words  to  college  students.  We  are  developing 
seven  different  Instructional  strategies  to  teach  the  new  words. 
Our  research  objective  Is  to  assess  the  effectiveness  of  each 
strategy  and  to  determine  which  strategies  promote  transfer. 

Prom  the  findings  of  our  research  we  hope  to  be  able  to  develop 
prescriptions  for  teaching  vocabulary  that  are  both  effective  and 
efficient,  as  shown  through  empirical  tests. 

We  begin  by  first  recognizing  that  competence  with  a par- 
ticular word  means  that  the  student  can  do  a variety  of  things 
with  It:  s/he  can  tell  you  what  It  means,  use  It  In  a sentence, 
differentiate  It  from  other  words,  etc.  There  are.  In  effect,  a 
variety  of  behaviors  that  reflect  "knowing"  the  meaning  of  a word. 
An  Instructional  program  designed  to  teach  word  knowledge  ought  to 
build  each  of  these  behaviors.  The  question  that  we  therefore 
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must  address  is  how  to  design  Instruction  to  produce  these 
different  learning  outcomes  In  the  most  effective  and  In  the  most 
efficient  manner. 

Prescriptions  from  design  theory 

Design  theories  such  as  Chose  developed  by  Gagn4  (1977); 

Gagn£  and  Briggs  (1974);  Klausmeler,  Ghatala,  & Prayer  (1974);  and 
Merrill  & Wood  (1975),  state  that  different  Instructional 
conditions  are  needed  for  different  types  of  learning  content 
and/or  for  different  types  of  learning  skills.  When  our  Individual 
vocabulary  objectives  are  analyzed  In  terms  of  existing  typologies, 
we  find  that  we  are  in  fact  working  with  different  types  of 
learned  performances.  Taking  another  tact,  we  can  apply  Merrill 
and  Wood’s  system  for  effective  Instructional  strategy  design  to 
determine  what  It  would  prescribe  for  our  vocabulary  design  problem. 
Working  through  the  Merrill  and  Wood  system  (see  Block  «■  McCaslin  1978 
for  an  extended  discussion  of  the  logic  of  applying  the  Merrill  and 
Wood  system)  led  us  to  conclude  again  that  we  are  Indeed  dealing 
with  different  types  of  learned  behaviora.  Since  different 
Instructional  conditions  are  required  for  different  types  of 
learning  outcomes,  as  developers,  we  will  need  to  design  an 
Instructional  strategy  for  each  learning  outcome.  And,  these 
strategies  should  be  designed  so  they  specifically  teach  toward 
each  outcome.  For  the  design  problem  we  face,  a one-to-one 
matching  rule  Is  in  effect:  for  each  terminal  objective,  design 
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theories  tell  us  there  Is  to  be  an  instructional  procedure 
matched  to  it.  If  we  have  n learning  outcomes,  we  need  n in- 
structional strategies,  according  to  design  theory  at  least. 

To  build  each  outcome  performance  in  the  student,  each  student 
will  need  to  experience  each  instructional  strategy.  The 
instructional  prescription  from  design  theory  is  Indeed  quite 
clear. 

It  is  pertinent  here  to  note,  however,  that  design  theories 
have  been  formulated  to  allow  the  development  of  instructional 
prescriptions  that  are  more  or  less  "guaranteed"  effective. 

But  these  prescriptions  are  not  necessarily  efficient  and  our 
vocabulary  prescription  is  a good  case  in  point.  With  our  rule 
that  there  must  be  one  strategy  for  each  outcome,  students  will 
need  to  receive  instruction  through  all  strategies,  if  all 
behaviors  are  to  be  built.  Anyone  concerned  with  instructional 
costs  and  the  use  of  learner  time  will  immediately  see  that  this 
prescription  is  an  "expensive"  one.  To  cut  back  on  it,  we  would 
need  to  be  able  to  believe  in  the  possibility  of  transfer,  that  is, 
that  instruction  by  one  strategy  builds  more  than  a single  outcome. 
Let  us  examine  this  notion  more  closely  by  considering  the 
hypothetical  empirical  basis  for  the  expensive,  all-strategies 
prescription. 

Empirical  evidence  and  instructional  prescriptions 

Figure  1 presents  the  hypothetical  results  of  an  experiment 
evaluating  four  methods  of  vocabulary  instruction.  The  x-axls 
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represents  four  different  outcome  measures;  the  y-axls  the  prob- 
ability of  correct  performance  on  the  measures.  As  shown  at  the 
upper  left,  designers  would  hypothesize  that  training  by  Instruc- 
tional Procedure  1 would  show  best  results  on  Outcome  Measure  1, 
the  measure  directly  addressed  by  the  training  procedure.  Per- 
formance on  other  outcome  measures  by  a subject  trained  through 
Procedure  1 would  presumably  be  substantially  poorer.  Similarly, 
Instructional  Procedure  2 would  produce  good  results  on  Outcome  2, 
Instructional  Procedure  3 on  Outcome  3,  etc.  The  graphs  portray 
the  results  on  which  an  all-strategies  prescription  is  based. 

They  portray  a characteristic  peaking  of  achievement  at  the 
outcome  that  is  the  target  of  the  instructional  strategy. 

However,  in  direct  conflict  with  a design  theory  prediction 
are  a set  of  actual  results  obtained  in  a study  by  Johnson  and 
Stratton  (1966).  In  the  Johnson  and  Stratton  study,  undergraduate 
psychology  students  learned  four  vocabulary  concepts  by  one  of 
five  teaching  methods.  Four  of  the  five  teaching  methods  were 
designed  so  they  would  directly  teach  toward  one  of  four  different 
learning  outcomes.  The  four  teaching  methods  were:  definitions, 
sentences,  classification,  and  synonyms.  There  were  four  tests 
measuring  the  outcomes.  Each  test  required  a different  behavior: 
a definition  statement,  a completion  of  a sentence,  a classification 
of  examples,  and  a synon3rm  selection.  Instruction  was  done  with 
paper  and  pencil  materials.  The  four  individual  Instructional 
methods  were  designed  to  be  as  distinct  from  one  another  as 


i possible  - the  stimuli  presented  and  the  types  of  responses  re- 

' qulred  of  subjects  were  different  among  the  four  methods.  After 

Instruction  by  one  method,  students  took  both  the  test  matched  to 
that  method  and  the  other  three  tests.  In  this  way,  both  direct 
i Instructional  effects  (effects  of  method  ^ on  test  1)  and  Indirect 

effects  (effects  of  method  ^ on  test  were  assessed.  Johnson 
and  Stratton's  results  for  the  four  Individual  methods  are 

I 

displayed  In  Figure  2. 

As  can  be  seen  by  Figure  2,  results  of  the  Johnson  and 

I Stratton  study  do  not  show  peaking  on  the  learning  outcome 

I 

I matched  to  the  Instructional  method.  That  Is,  there  are  no 

1 

direct  Instructional  effects.  Even  further,  there  are  sizeable 
Indirect  effects.  That  Is,  students  learning  by  one  method  also 
did  quite  well  on  tests  matched  to  the  other  methods;  apparently, 

I learning  by  one  method  transferred  to  tests  based  on  the  other 

I 

methods.  Overall,  the  pattern  of  the  Johnson  and  Stratton 

results  appears  the  same  despite  the  Instructional  method  used. 

That  Is,  the  pattern  of  effects  appears  quite  Independent  of 

3 

' Instructional  method. 

I Discussion  of  the  apparent  contradiction 

I 

If  we  compare  the  state  of  the  world  assumed  by  design 
I theory  to  the  findings  of  Johnson  and  Stratton,  there  Is  a clear 

3 

Statements  we  have  made  here  are  verified  by  the  statistical 
tests  that  Johnson  and  Stratton  performed. 
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discrepancy  which  must  be  resolved  to  permit  development  decisions. 
Basically,  we  believe  the  weight  of  the  evidence  Is  on  the  side  of 
design  theory  tor  two  reasons.  First,  design  theory  Itself  Is 
developed  from  a broad  base  of  empirical  findings  at  the  heart 
of  which  is  a principle  of  tralnlng-to-test  transfer.  Second, 
we  believe  that  the  Johnson  and  Stratton  training  procedure  did 
not  exert  sufficient  control  over  student  learning  processes;  so 
that  it  was  not  a well  Instrumented  test  of  the  effects  of  various 
Instructional  methods. 

Findings  from  transfer  research  have  culminated  In  the  principle 
that  training  to  test  transfer  Is  enhanced  to  the  extent  that  proper- 
ties of  the  training  are  similar  to  the  properties  of  the  test. 

The  Johnson  and  Stratton  methods  and  test  were  quite  similar  but 
their  results  clearly  contradict  this  principle  of  transfer.  For 
methodological  reasons,  however,  we  do  n>t  believe  their  data  represent 
a serious  challenge.  Johnson  and  Stratton  found  direct  effects, 
and  despite  large  differences  among  their  Instructional  procedures 
the  patterns  of  results  are  quite  similar.  Thus,  It  Is  quite 
possible  that  the  Independent  variable  was  not  even  Implemented. 

That  Is,  the  degree  of  control  over  student  learning  processes 
possible  with  paper  and  pencil  materials  was  Insufficient  to  produce 
the  direct  effects  that  may  really  be  there,  and  that  the  weight  of 
empirical  evidence  suggests  are  there.  With  more  stringent  control 
over  Instructional  processes,  direct  effects  may  well  appear.  Use  of  a 
computer  with  lessons  In  a CAI  mode  permits  this  more  precise 
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control.  Based  on  these  considerations,  for  the  development 
context  In  which  we  work,  It  seems  most  appropriate  to  develop  a 
strategy  for  each  learning  outcome. 

It  would  trivialize  the  Importance  of  our  research  to  simply 
dismiss  the  Johnson  and  Stratton  results  on  a methodological  point. 
Consider  what  these  results  mean  If  they  are  in  fact  real  and 
generallzable  to  our  situation  using  a computer.  They  would 
Indicate  sharp  dlsconf irmatlon  of  design  theory  In  our  situation, 
which  In  turn  Indicates  that  design  theory  may  not  be  a general 
theory  but  rather  Is  subject  matter  specific.  Secondly,  to  the 
extent  that  particular  strategies  produce  indirect  effects,  all 
strategies  would  not  be  needed,  thus  there  would  be  significant 
gains  In  instructional  efficiency.  What  we  have  decided  to  do  Is 
attempt  to  build  Individual  strategies  so  that  they  are  targeted 
toward  a particular  outcome  (that  Is,  they  produce  direct  effects) 
but  also  so  they  permit  the  achievement  of  Indirect  effects  that 
are  practically  significant.  Our  attitude  toward  what  we  can 
accomplish  Instructlonally  reflects  on  what  we  think  the  state  of 
the  world  is  empirically.  We  believe  that  the  actual  state  of  the 
world  Is  somewhere  In  between  the  strong  peaking  presumed  by 
design  theory  and  the  absence  of  peaking  obtained  In  the  Johnson 
and  Stratton  research. 

In  another  paper  (see  Block  & McCaslln,  1978)  we  have 


developed  a quantitative  model  that  helps  us  to  choose  Instructional 
methods  to  maximize  certain  performance  criteria.  If  we  have  a 
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numerical  estimate  of  the  size  of  the  direct  effects  and  a numerical 
estimate  of  the  size  of  the  indirect  effects  that  are  associated 
with  a given  method,  and  we  have  mathematical  functions  describing  how 
the  effects  combine  when  methods  are  used  together,  we  can  select 
combinations  of  methods  to  help  us  achieve  certain  specific  ends. 

Time  restrictions  do  not  permit  our  discussing  the  model  here.  We 
do  hope,  though,  that  through  more  precise  formulations  of 
Instructional  design  questions  and  the  conduct  of  co-ordinate 
empirical  tests,  we  can  refine  design  theory  and  become  able  to 
make  specific  Instructional  suggestions  to  teachers  to  help  them 
guide  student  learning  more  efficiently. 

To  summarize,  what  we  would  like  to  be  able  to  demonstrate 
through  our  development  work  is  that  the  all-strategies  prescrip- 
tion of  design  theory  is  Incorrect  and  that  it  is  possible  to 
achieve  acceptable  levels  of  performance  on  all  criterion  tests 
using  fewer  than  the  complete  set  of  strategies  available.  If 
this  result  can  be  achieved,  some  smaller  combination  of  teaching 
modules  than  the  full  set  should  produce  acceptable  levels  of 
performance  on  the  outcome  measures,  at  a lower  cost  in  Instructional 
time  (i.e.,  lower  compared  to  a prescription  that  requires  all 
strategies  to  be  given).  That  la,  three  or  four  modules  may  do 
the  Job  of  seven.  The  purpose  of  our  research  is  to  attempt  to 
produce  the  outcomes  we  desire  and  then  to  revise  design  theory 
if  need  be.  We  must  develop,  Implement,  and  evaluate  the  vocabulary 
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Instruction  we  produce,  instruction  that  will  be  presented  to 
college  students  via  the  computer.  In  the  remainder  of  this 
presentation,  we  want  to  turn  from  a description  of  or  conceptual 
framework  and  research  objectives  to  a discussion  of  the  rationale 
and  design  of  our  instructional  modules. 

The  design  of  the  vocabulary  instructional  strategies 

The  seven  outcomes  that  represent  our  instructional  goals 
are  found  in  Figure  3.  The  word  in  parentheses  following  each 
outcome  is  the  name  we  have  given  the  instructional  module  that 
teaches  toward  that  outcome.  The  design  of  our  modules  was 
shaped  by  what  we  hope  to  demonstrate;  that  is,  we  want  to  show 
that  the  modules  can  produce  a direct  effect,  i.e.,  a peaking  on 
their  matched  criterion  test.  But  we  also  want  to  show  evidence 
of  indirect  effects,  i.e.,  that  teaching  via  a particular  module 
transfers  to  tests  based  on  the  other  modules. 

To  obtain  direct  effects,  we  retained  the  response  identity 
property  between  instruction  ^ and  - test  used  by  Johnson  and 
Stratton  in  their  research.  That  is,  a test  requiring  classifi- 
cation is  taught  toward  by  a method  that  requires  students  to 
classify,  and  so  forth  for  the  other  methods  and  tests.  This 
property,  of  course,  is  a condition  enabling  training 
to  test  transfer.  To  enhance  the  chances  of  indirect  effects, 
we  supplemented  the  information  about  word  meaning  contained  in 
each  method,  over  and  above  what  Johnson  and  Stratton  did. 
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In  the  Johnson  and  Stratton  research,  a "method"  of  Instruc- 
tion was  defined  In  terms  of  the  format  of  the  stimulus  and  the 
particular  kind  of  response.  We  analyzed  the  Johnson  and 
Stratton  methods  to  determine  which  stimuli  were  paired  with 
which  responses  within  each  of  their  Instructional  methods.  We 
discovered  that  Johnson  and  Stratton  paired  stimuli  and  responses 
In  such  a way  that  the  content,  or  object,  of  the  response  was 
presented  in  the  stimulus  portion  of  the  method.  For  example,  the 
presentation  of  a definition  as  a stimulus  was  paired  with  a defini- 
tion paraphrase  as  a response.  In  this  tvpe  of  methods  design,  sub- 
jects would  not  have  to  recode  the  information  presented  into 
another  linguistic  form  (as  they  would  have  to  If  the  stimulus 
were  a definition  and  the  response  sentence  construction).  Following 
this  procedure  seemed  entirely  sensible  to  us  since  It  maximizes  the 
duration  of  the  subject's  exposure  to  Instructional  content 
in  the  form  that  It  Is  to  be  learned.  It  also  enables  the 
designer  to  easily  keep  the  different  instructional  methods 
distinct  from  one  another,  a condition  which  we  believe  Is  vital 
If  we  are  to  achieve  direct  Instructional  effects. 

Other  design  guidelines  came  from  the  Instructional  pre- 
scriptions for  concept  teaching  developed  by  Merrill  and  Tennyson 
(1977).  These  were  extremely  helpful  to  us  In  the  design  of 
one  of  our  modules,  CLASSIFY.  Beyond  the  general  suggestions 


taken  from  Johnson  and  Stratton  and  from  Merrill  and  Tennyson, 
added  details  of  the  Instructional  strategies  had  to  be  specified. 
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Instructional  strategies  are  comprised  of  smaller  segments  of 
Instruction  called  routines  and  these  routines  were  designed  by 
following  a shaping  procedure,  l.e.,  gradually  reducing  the 
stimulus  support  for  the  required  terminal  response  as  the  lesson 
proceded.  In  another  paper  we  have  provided  a more  extensive 
rationale  for  the  design  decisions  made  In  the  course  of  specify- 
ing a module.  We  have  had  time  only  to  sketch  them  here. 

In  the  remaining  time,  we'll  describe  DEFINE,  WORD  RELATIONS, 
and  CLASSIFY  In  some  detail.  WORDS  IN  CONTEXT,  CREATE,  WORD 
LINE,  and  EQUIVALENTS  will  Just  be  sketched. 

The  content  structure  taught  In  the  DEFINE  module  Is  the 
definition  of  a vocabulary  word;  the  terminal  response  task  of 
the  module  Is  to  construct  a definition  paraphrase.  Our  computer 
lesson  design  segments  the  learning  process  Into  elementary 
events  and  through  suitable  design  of  the  Instructional  routines, 
guides  the  learning  process  through  a series  of  stages.  We 
designed  the  module  to  accomplish  several  purposes  - to 
call  attention  to  the  key  elements  of  the  definition  content  — 
the  critical  attributes  of  the  definition;  to  control  the  number 
of  rehearsals  or  encounters  with  each  critical  attribute;  and 
to  Institute  a form  of  retrieval  practice  In  which  students  must 
construct  a definition  from  memory.  The  conceptual  framework  that 
rationalizes  this  Instructional  design  Is  the  Frase  (1975)  model 
of  prose  processing  In  which  there  Is  an  attempt  to  relate 
Instructional  programming  characteristics  to  the  prose  learning 


processes  of  rehearsal,  relation,  and  retrieval. 
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The  DEFINE  module  comprises  seven  exercise  routines.  As 
we  describe  the  tasks  In  order  by  routine,  you  may  want  to  refer 
to  Figure  4,  which  presents  simulated  DECscope  video  terminal 
screen  displays  for  the  routines. 

Routine  1:  Pronounce.  This  Is  the  first  routine  In  all 
seven  modules.  The  routine  Identifies  the  target  word  and  pro- 
vides a phonetic  pronunciation  key,  with  the  direction  to  the 
subject  to  pronounce  the  word.  The  caret  on  the  screen  display 
alerts  the  subject  to  press  the  return  key  In  order  to  proceed. 

Routine  2:  Definition.  A definition  of  the  target  word  Is 
then  presented,  emphasizing  Its  critical  attributes  by  separating 
them  visually  from  the  rest  of  the  display.  For  nouns,  such  as 
sycophant  — the  concept  used  In  the  simulated  screen  display  — 
the  definition  assumes  a genus  et  differentia  form;  that  Is,  It 
places  the  target  word  In  a higher  order  class  and  then  characterizes 
It  In  a specific  way.  Definitions  for  verbs  and  adjectives  use 
synonyms  plus  contextual  information. 

Routine  3;  Type  word  from  memory.  In  this  routine,  with  the 
same  display  as  In  Routine  2 as  a stimulus,  the  subject  studies 
the  target  word  until  ready  to  type  It  from  memory.  Then,  as  a 
response,  the  subject  types  the  word  after  the  stimulus  has  been 
erased  from  the  screen.  Feedback  here  either  confirms  a correct 
response  or  re-presents  the  word,  which  Is  then  retyped  by  the 
subject  while  the  word  remains  on  view. 

Routine  4t  Definition  with  attribute  labeling.  The  form 
class  (part  of  speech)  of  the  target  word  Is  Identified  In  this 
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routine  with  a general  statement  alerting  the  subject  to  the  format 
that  a definition  of  words  of  this  form  class  should  assume.  Then 
the  definition  of  the  target  word  Is  presented  again,  this  time 
with  Its  critical  attributes  labeled. 

Routine  5;  Multiple  choice  paraphrase  of  each  critical 
attribute  of  definition.  Next,  the  subject  receives  a multiple 
choice  exercise  In  which  a partial  definition  paraphrased  from  the 
original  presentation  appears  on  the  screen;  the  subject  completes 
the  definition  by  selecting  the  correct  paraphrase  of  the  critical 
attribute  that  Is  missing.  Feedback  for  a correct  response 
confirms  the  response  and  then  fills  the  missing  critical  attribute 
Into  the  definition.  Feedback  for  an  Incorrect  response  tells 
the  subject  to  try  again.  After  two  Incorrect  responses,  the 
critical  attribute  Is  filled  Into  the  definition  and  the  subject 
studies  the  definition  before  going  on.  This  routine  is  repeated 

i 

for  the  number  of  critical  attributes  contained  In  the  target  word. 

For  sycophant,  the  routine  would  be  repeated  two  more  times  while 

1 

a paraphrase  of  each  of  the  two  other  critical  attributes  Is  selected.  ! 

i 

Routine  6;  Multiple  choice  paraphrase  of  all  critical  ^ 

attributes.  In  this  routine,  all  critical  attributes  for  the 
definition  are  selected  and  then  typed  by  the  subject  within  one 

I 

exercise,  not  Individually  as  In  Routine  5.  This  routine,  therefore, 
begins  to  approximate  definition  construction.  The  subject's 
responses  and  feedback  are  similar  to  those  In  Routine  5. 
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Routine  7;  Definition  conatructlon.  In  the  final  routine 
of  the  module,  the  subject  composes  and  types  a definition  of  the 
target  word.  S/he  Is  cued  to  use  the  target  word  In  the  definition 
and  to  phrase  the  definition  to  make  It  read  appropriately  for 
a word  of  Its  form  class.  After  making  the  response,  as  feedback, 
the  subject  compares  his  or  her  definition  with  the  original 
definition. 

The  criterion  test  for  this  module  Is  definition  construction. 
It  Is  Identical  to  the  exercise  In  Routine  7,  eliminating  the 
feedback. 

That's  Module  DEFINE;  now  let's  look  at  WORD  RELATIONS.  Our 
WORD  RELATIONS  module  Is  based  upon  an  application  of  a process 
model  for  long  term  memory  In  which  Information  Is  stored  as 
semantic  networks.  In  the  Rumelhart,  Lindsay,  and  Norman  (1972) 
model,  the  network  of  concepts  Is  Interconnected  by  relations. 
Meanings  are  established  through  the  relations  that  hold  among 
various  concepts.  In  our  WORD  RELATIONS  modules,  then,  the 
target  word  Is  presented  along  with  another  word  that  Is  related 
In  some  way.  The  subject  determines  the  relationship  between 
the  two  words.  Our  module  attempts  to  be  a directed  pathfinding 
strategy  between  the  target  word  and  other  words  that  would 
likely  be  nearby  nodes  In  the  subject's  memory  representation. 
Figure  5 presents  a simulated  screen  display  for  the  WORD  RELATIONS 
routines. 


' 1 
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Routine  1:  Pronounce.  As  mentioned  previously,  this  is  the 
first  routine  in  all  of  our  modules.  Just  as  in  DEFINE,  the 
routine  here  identifies  the  target  word  and  provides  a phonetic 
pronunciation  key,  with  the  direction  to  the  subject  to  pronounce 
the  word. 

Routine  2:  Definition.  Just  as  in  DEFINE,  a definition  of 
the  target  word  Is  then  presented,  emphasizing  Its  critical 
attributes  by  separating  them  visually  from  the  rest  of  the  display. 

Routine  3;  Forced  paraphrase.  This  routine  represents  an 
attempt  to  get  a short  paraphrase  of  the  definition  Into  Che 
subject's  working  memory,  since  the  definition  of  the  target  word 
will  not  be  on  view  as  the  subject  determines  Che  relationships 
between  words.  Here,  the  subject  selects  the  letter  of  the  phrase 
Chat  Is  closest  In  meaning  to  the  target  word.  Feedback  either 
confirms  a correct  response  or  Instructs  subjects  with  Incorrect 
responses  to  reread  the  definition  and  Chen  to  answer  the 
question  again. 

Routine  4;  Type  word  from  memory.  Similar  to  a routine  In 
DEFINE,  with  the  target  word  as  a stimulus,  the  subject  studies 
the  target  word  until  ready  Co  type  it  from  memory.  As  a response, 
Che  subject  types  the  word  after  the  stimulus  has  been  erased 
from  the  screen.  Feedback  here  either  confirms  a correct  response 
or  re-presents  the  word,  which  Is  then  retyped  by  the  subject 
while  the  word  remains  on  view. 

Routine  5;  Explanation  of  relations.  At  the  beginning  of 
this  routine,  a relation  Is  established  between  Che  target  word 
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and  another  word.  After  that,  another  word  bearing  the  same 
relationship  appears  with  the  target  word,  and,  as  a response, 
the  subject  Identifies  the  relationship  by  typing  It  In.  Feed- 
back for  a correct  response  confirms  the  subject's  answer. 

Feedback  for  an  incorrect  response  Identifies  the  correct  rela- 
tionship for  the  subject.  In  the  final  part  of  this  routine, 
the  sentence  is  rephrased  as  a question  with  multiple  choice 
responses,  and  the  subject  selects  the  one  response  of  the  three 
that  establishes  the  true  relationship  between  the  two  words. 

Once  again,  feedback  for  a correct  response  confirms  the  answer; 
feedback  for  an  incorrect  response  alerts  the  subject  to  try 
again.  This  routine  Is  repeated  for  the  number  of  relationships 
established  for  the  target  word.  For  sycophant . the  relations 
to  be  used  are:  quality,  goal,  act,  and  target.  The  routine 
would  be  repeated  as  each  of  these  relations  is  set  up. 

Routine  6:  Practice  relations.  In  this  routine,  the  subject 
Identifies  the  relationship  between  selected  words  and  the  tar- 
get word.  The  relations  are  the  same  as  those  established  in 
Routine  5;  the  words  that  form  the  relationships  are  different. 
Feedback  confirms  a correct  response  or  identifies  the  correct 
relation  In  the  case  of  an  Incorrect  response.  When  an  In- 
correct response  has  been  given,  the  question  Is  re-presented  at 
the  end  of  the  series  of  questions.  There  are  approximately 
20  questions  In  this  routine  — In  the  case  of  sycophant . five 
questions  for  each  of  the  four  relationships  that  have  been 


established. 
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The  criterion  test  for  this  module  la  identical  to  the  task 
In  Routine  6,  eliminating  feedback.  Because  this  test  Is  based 
upon  a model  of  memory,  we  are  considering  It  to  be  experimental 
In  nature.  It  will  be  of  great  Interest  to  us  to  determine 
whether  a subject  receiving  Instruction  solely  through  the  WORD 
RELATIONS  module  will  reflect  a difference  In  cognitive  structure 
from  those  subjects  receiving  Instruction  through  the  other 
modules. 

Now  let's  proceed  to  the  CLASSIFY  module.  The  rationale 
for  CLASSIFY  Is  based  closely  upon  the  design  guidelines  specified 
by  Merrill  and  Tennyson  (1977)  for  teaching  concepts.  CLASSIFY 
comprises  five  exercise  routines.  Figure  6 presents  simulated 
screen  displays  for  the  CLASSIFY  routines.  Here  we  will  dwell 
upon  only  those  routines  chat  are  unique  to  CLASSIFY,  those  not 
contained  In  either  DEFINE  or  WORD  RELATIONS. 

Routines  1 and  2 have  been  discussed  previously. 

Routine  3;  Matched  examples  and  nonexamples.  Here,  a 
situational  example  of  Che  target  word  Is  presented,  labeled  as 
an  EXAMPLE.  The  subject  answers  a yes-no  question,  focusing  on 
one  of  the  target  word's  critical  attributes  by  typing  a Y for 
a yes  answer  or  an  N for  a ^ answer.  Feedback  after  Che  response 
alerts  the  subject  Co  the  correct  response  and  provides  attribute 
Isolation  help;  Chat  Is,  Che  feedback  assists  the  subject  In 
encoding  Che  example  In  terms  of  a critical  attribute.  A matched 
situational  nonexample  of  the  target  word  Is  then  presented. 


18 


r 

1 

t 

! 

i 


j 

I 

! 


1 


labeled  as  NOT  AN  EXAMPLE.  The  matched  nonexample  la  visually 
paired  on  the  screen  with  the  example.  The  same  yes-no  question 
Is  presented  along  with  the  nonexample.  Once  again,  feedback 
after  the  response  alerts  the  subject  to  the  correct  response 
and  provides  attribute  Isolation  help.  This  matched  example/non- 
example pairing  with  yes-no  questions  on  a critical  attribute 
Is  repeated  for  the  number  of  critical  attributes  contained  In 
the  target  word.  For  sycophant . Routine  3 would  be  repeated  two 
more  times. 

Routine  4:  Forced  choice  of  example.  Next,  a matched 
example/nonexample  pair  of  situations  Is  presented;  the  subject 
Is  Instructed  that  only  one  of  the  pair  is  an  example  of  the 
target  word.  The  subject  Identifies  the  number  of  the  Instance 
that  Is  the  example.  Feedback  alerts  the  subject  to  the  correct 
response  and  Identifies  the  specific  wording  In  the  example  that 
"gives  It  away"  as  the  example.  The  number  of  times  that  this 
routine  Is  repeated  Is  also  dependent  upon  the  number  of  critical 
attributes  In  the  target  word. 

Routine  5:  Classification.  In  the  final  routine  of  Module 
CLASSIFY,  one  Instance  at  a time  la  presented  to  the  subject, 
with  the  direction  to  Identify  the  Instance  as  an  example  or  not 
as  an  example  of  the  target  word.  This  routine  is  repeated  a 
varying  number  of  times,  depending  upon  the  difficulty  of  the 
word  being  taught.  For  sycophant,  ten  Instances  are  presented. 
Feedback  for  a correct  response  confirms  the  response  as  correct. 
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Feedback  for  an  Incorrect  response  constructs  a matched  example/ 
nonexample  pair  out  of  the  Instance  being  presented  and  labels  for 
the  subject  which  Instance  of  the  pair  is  the  EXAMPLE  and  which 
is  NOT  THE  EXAMPLE. 

The  criterion  test  for  this  module  Is  the  classification 
task  specified  by  Merrill  and  Tennyson;  that  is,  when  given  the 
target  word  and  shown  representations  of  specific  instances 
representing  examples  and  nonexamples  of  the  class,  the  subject 
Identifies  those  situations  that  are  members  of  the  class  and  those 
that  are  not.  The  criterion  test  is  the  same  as  the  exercise 
presented  in  Routine  5,  using  different  instances  and  eliminating 
feedback. 

Very  briefly,  in  the  WORDS  IN  CONTEXT  module,  the  subject 
reads  a short  story  containing  the  target  word,  and  then  completes 
a series  of  sentences  by  using  the  target  word  meaningfully. 

It  currently  seems  necessary  to  have  the  sentence  fragments  in 
the  response  task  end  with  the  word  because  in  order  to  assure 
that  the  target  word  is  used  meaningfully. 

Module  CREATE  is  targeted  toward  example  construction.  It 
is  a discovery  version  of  CLASSIFY,  the  rationale  being  that  a 
task  requirement  to  Induce  a concept  from  examples  might  aid  in 
the  development  and  memory  for  the  critical  attributes. 

The  WORD  LINE  module  will  teach  the  target  word  in  the 
context  of  other  words  of  the  same  form  class  in  such  a way  that 
the  context  words  plus  the  target  word  can  be  arranged  along  a 
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perceptual,  affective,  or  semantic  continuum.  The  roots  of  the 
rationale  for  this  module  are  found  In  Miller  and  Johnson-Lalrd' s 
(1976)  notions  of  semantic  domain  and  In  Klein  and  Salts 's  (1976) 
conceptions  that  there  are  semantic  dimensions  along  which  words 
can  be  arranged  or  rated.  Figure  7 presents  some  sample  word  lines. 

The  EQUIVALENTS  module  will  be  a very  simple  comparison 
module.  Its  teaching  sequence  will  contain  repeated  practice  on 
the  correct  response  contained  on  our  multiple-choice  synonym 
pretest.  This  module  Is  Included  In  our  series  of  Instructional 
methods  to  determine  whether  more  complex  Information  structures 
such  as  those  found  In  our  other  six  modules  are  really  necessary 
to  support  good  performance  on  our  criterion  tests,  or  whether 
simpler  types  of  content,  such  as  that  found  In  this  module, 
might  possibly  suffice. 

These  then  are  our  seven  Instructional  modules.  Now,  for 
the  moment  that  Is  left,  let's  view  the  experiments  procedurally. 

We  are  still  In  the  Instructional  design  phase  of  our  research, 
but  this  Is  how  we  foresee  that  the  experiments  will  likely  run: 
There  are  154  word  concepts  In  our  Instructional  database. 

College  student  volunteers  at  the  Learning  Skills  Center  at  our 
university  will  be  the  subjects.  The  subjects  will  be  pre- 
famlllarlzed  with  the  conventions  of  using  the  DECscope  video 
terminal  devices  as  they  are  connected  to  our  Digital  Equipment 
Corporation  PDP-15  computer  equipped  with  a medium-scale  time- 
sharing system.  (Incidentally,  our  research  has  been  assigned 
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a high  enough  priority  In  the  time-sharing  system  that  there 
should  be  relatively  little  waiting  time  for  the  subjects  as  their 
stimuli  are  printed  and  responses  processed  by  the  PDP-15).  In 
general,  the  plan  for  each  segment  of  vocabulary  Instruction  Is 
that  on  the  first  day,  subjects  sign  onto  the  CAI  system  and  take 
the  multiple-choice  synonym  pretest  until  they  have  missed  ten 
words.  The  pretest  items  are  constructed  from  the  154  words  In 
our  database.  Then  subjects  will  receive  Instruction  on  the 
words  that  were  missed.  Depending  upon  which  experiment  Is  In 
progress,  they  will  either  receive  Instruction  from  only  one  of 
the  modules,  from  a combination  of  all  seven  modules,  or  from 
some  other  subset  of  the  seven  modules.  They  will  return  after 
an  interim  of  one  day  to  take  an  Interim  posttest  with  automatic 
reteachlng  of  words  missed.  Following  another  day's  absence, 
they  will  return  for  a final  session  to  take  the  battery  of  criterion 
tests.  In  the  next  segment  of  Instruction,  the  pretest  will 
continue  until  ten  more  words  are  missed.  Instruction  and 
testing  will  then  proceed  In  the  manner  Just  described.  This 
cycle  will  continue  ■>ntll  the  words  on  the  pretest  are  exhausted. 

We  also  plan  to  add  a standardized  verbal  ability  test  to  the 
experimental  design  In  order  to  determine  post  hoc  whether  there 
Is  an  Interaction  of  ability  with  method  reflected  In  the  relative 
sizes  of  direct  and  Indirect  Instructional  effects. 

In  summary,  we  are  expecting  with  computer  Instrumentation 
that  there  will  be  both  specific  methods  effects  and  Indirect 
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methods  effects  In  our  program  of  vocabulary  instruction.  What 
we  want  to  demonstrate  is  that  instruction  can  be  more  efficient 
than  we  currently  tliink,  because  a subset  of  modules  is  all  that 
is  needed  for  a task  that  we  thought  would  require  a set  matched 
to  each  criterion  test.  We  are  presently  in  the  first  stage  of  our 
research  in  which  we  are  calibrating  the  size  of  the  direct  and 
indirect  effects;  later  stages  will  require  studying  how  the 
combined  use  of  the  methods  confirms  or  dlsconflrms  our  decision 
theory  equations.  In  addition  to  improving  the  quality  of 
instructional  theory  that  teachers  are  taught,  we  hope  to  generate 
new  ideas  for  vocabulary  instruction  through  the  types  of 
techniques  that  we  have  developed  in  this  research  and  development 
effort. 
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1.  Stating  a definition  of  the  target  word;  (DEFINE). 

2.  Identifying  the  semantic  relationships  that  exist  between  the  target  word 
and  related  concepts;  (WORD  RELATIONS). 

3.  Differentiating  between  examples  and  non-examples  of  the  target  word;  (CLASSIFY). 

4.  Completing  sentences  meaningfully  using  the  target  word;  (WORDS  IN  CONTEXT). 

5.  Constructing  new  examples  of  the  concept  represented  by  the  target  word;  (CREATE). 

6.  Creating  lexical  structures  such  as  continua  within  which  the  target  word  it  located;  (WORD  LINE). 

7.  Selecting  a synonym  of  the  target  word  from  a set  of  dittractors;  (EQUIVALENTS) . 

Figure  3.  Seven  performance  outcomes  associated  with  word  knowledge. 
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Routine  2:  Definition 


Figure  4.  Simulated  OECscope  screen  displays  for  DEFINE  routines  using  the  target  word  tycophfnt. 
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Routine  3:  Type  word  from  memory 


Read  the  definition: 

Sometimes,  you  may  meet  a person  who  attempts  to  win 
favor  or  advancement  by  flattering  persons  of  influence. 

This  kind  of  person  who  wants  to  get  ahead  by  soft-soapmg 
is  called  a SYCOPHAN't. 

Thus,  a SYCOPHANT  is;  a person 

who  tries  to  get  ahead 
by  buttering  up  influential  people. 

Study  the  new  word. 

Press  return  when  you  are  ready 
to  spell  it  from  memory.> 


(Only  the  first  screen  display  of  this  routine  is  presented.) 


Routine  4;  Definition  with  attribute  labeling 


Figure  4.  (Continued) 
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Routine  S;  Multiple  choice  paraphrase  of  each  of  the  definition's  critical  attributes 


(Only  the  first  screen  display  of  this  routine  is  presented.  An  option  on  this 
routine  is  to  continue  the  definition  presentation  from  Routine  4.) 


Routine  6:  Multiple  choice  paraphrase  of  all  critical  attributes 


A sycophant  is  (GEN  CLASS)  who  tries  to  (SPEC  QUAL  1)  by  (SPEC  DUAL  2). 


SOMEONE 

ANYTHING 

ANYONE  OR  ANYTHING 


HARM  HIS  FRIENOS 
BE  HELPFUL 
BECOME  SUCCESSFUL 


PRAISING  POWERFUL  PEOPLE 
WORKING  HARO 
BORROWING 


Complete  the  definition  by  typing  the 
correct  key  terms.  Press  return  after 
each  key  term. 

A sycophant  is  > 


(Only  the  first  screen  display  of  this  routine  is  presented.) 


Figure  4.  (Continued) 
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Routine  7:  Definition  construction 


Type  a definition  of  sycophant. 

Start  by  typing  the  word,  then  identify 

its  GENERAL  CLASS  and  SPECIAL  QUALITIES. 

Press  return  at  the  end  of  each  line  and 
again  when  you  have  finished. 


Check  your  definition  by  comparing  it 
to  this  one: 

A sycophant  is  a person  who  tries  to  gat  ahead  by  buttering  up 
influential  people. 

Note  that  SYCOPHANT  has  a general  class  and  two  special  qualities. 
Press  return  for  the  next  word.> 


subject's  response.  This  screen  display  is  the  final  display  of  the  routine.) 


Figure  4.  (Continued) 


Routine  1:  Pronounce 


Routine  2:  Definition 


Figure  5.  Simulated  DECscope  screen  displays  for  the  WORD  RELATIONS  routines 
using  the  target  word  sycophant. 


Routine  3;  Forced  paraphrase 


Sometimes,  you  may  meet  a person  who  attempts  to  win 
favor  or  advancement  by  flattering  persons  of  influence. 

This  kind  of  person  who  wants  to  get  ahead  by  soft-soaping 
is  called  a SYCOPHANT. 

Thus,  a SYCOPHANT  is:  a person 

who  tries  to  get  ahead 
by  buttering  up  influential  people. 
One  of  these  phrases  captures  the  meaning  of  sycophant. 

a)  a hard-working  b)  a fast-talking  c)  a wealthy 
achiever  apple-polisher  fat  person 

its  letter:  > 


Routine  4:  Type  word  from  memory 


Sometimes,  you  mey  mHt  a person  who  attempts  to  win 
favor  or  advancement  by  flattering  parsons  of  influence. 

This  kind  of  person  who  wonts  to  get  ahead  by  soft-soap'ing 
is  called  a SYCOPHANT. 

Thus,  a SYCOPHANT  is:  a person 

who  tries  to  get  ahead 
by  buttering  up  influential  people. 

Study  the  new  word. 

Pran  return  when  you  are  ready 
spell  it  from  memory.> 

(Only  the  first  screen  display  of  this  routine  is  presented.) 


Figure  5.  (Continued) 
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Routine  5:  Explanation  of  relations 


Routine  6:  Practice  relations 


Figure  5.  (Continued) 
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Routine  1 : Pronounce 


Routine  2:  Definition 


Figure  6.  Simulated  OECscope  screen  displays  for  the  CLASSIFY  routines  using  the  target  word  sycophant. 
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Routine  3:  Matched  examples  and  nonexamples 


This  is  an  EXAMPLE  of  a sycophant; 

a starlet  buttering  up  a well-known  film  director  in  order  to  get 
a leading  role 


This  is  NOT  AN  EXAMPLE  of  a sycophant; 

a starlet  dating  a film  director  because  she  likes  him 

Refer  to  the  NONEXAMPLE.  Type  Y or  N to  answer  this  question; 

Is  the  starlet  in  the  NON  EXAMPLE  buttering  up  the  director  in  order 
to  get  ahead? 

Type  your  answer  here;  > 


(Only  the  second  major  screen  display  of  the  routine  is  presented.) 


Routine  4:  Forced  choice  of  example 


One  of  the  instances  below  is  an  example  of  a sycophant. 

The  other  is  not.  Type  the  number  of  the  instance  that 
is  the  EXAMPLE  of  a sycophant. 

1)  an  applicant  at  a country  club  trying  to  become  a member  by 
filling  out  the  application  form  and  dropping  it  off  at 

the  club 

2)  an  applicant  at  a country  club  trying  to  become  a membar  by 
currying  favor  with  the  club’s  membership  director 


Type  your  answer  here;  > 


(Only  the  first  screen  display  of  the  routine  is  presented.) 


Figure  6.  (Continued) 
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Target  Word  1;  SYCOPHANT  (noun) 


evil 


Words  to  arrange  on  the  line:  murderer,  chHd-molester,  drug  pusher, 

thief,  braggart,  sycophant,  complainer, 
average  Joe,  humanitarian,  missionary, 
saint 

Possible  instances  to  be  rated  along  the  line: 

1.  a law-abiding  citizen 

2.  a drunk 

3.  Adolf  Hitler 

4.  an  apple-polisher 

5.  a Peace  Corps  volunteer 

6.  Albert  Schweitzer 


Target  Word  2:  ARTICULATE  (verb) 


good 


difficult-to-understand  easy-to-understand 

speech  speech 

Words  to  arrange  on  the  line:  garble,  slur,  mutter,  mumble,  whisper, 

talk,  pronounce,  articulate,  enunciate 

Possible  instances  to  be  rated  along  the  line: 

1.  a heavily-accented  voice 

2.  an  elementary  school  teacher's  voice 

3.  a voice  on  a heavily  overloaded  telephone  line 

4.  an  actor’s  stage  voice 

5.  a normal  conversational  voice 

6.  the  voice  of  a politician  who  is  trying  to  make  a point 


Figure  7,  Sample  word  lines. 


